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ABSTRACT 


A time domain oriented technique using periodic func- 
tions composed of first order segments was employed in the 
development of a real-time interactive computer audio 
synthesis system. A general purpose analog computer was 
B evamned to create non-monotonic function generators 
which are used to generate sequences of periodic functions 
Chat can be frequency and amplitude modulated.  The*system 
appropriate for experiments in psychoacoustics.  Explo- 
ration of the relationships between the physical and the 
perceptual significance of synthesis parameters of the tech- 
nique is aided by real-time frequency analysis programs and 
an audio output capability. The system includes an inter- 
active graphics terminal for conversational I/O and conven- 
шопај регјрћега1 devices Torrereatineg permanent records. | 
Tn preliminary testing, the technique and system displayed 
Pesmising posstibilitiesn Modifications to explore specific 


areas of perception in greater depth were considered. 
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ELI ITRODUNMV TON 


A. BACKGROUND 

Doundzeommuns cates informationen It 145 опевог Све: пос 
important and most widely utilized means by which humans 
communicate. But human communication implies not only the 
production and transmission of sound, but also the percep- 
pon or sound. The accelerated ¡progress of technology in 
the fields of electronics and computer science in the last 
daa ade паз vended to producesa: false confidence in our 
practical ability to duplicate or simulate human processes 
such as the perception of sound. The results have been 
aisappainting and expensive. The perception of sound is 
one of the most interesting and mystifying of human pro- 
Шээс апа its complexity has been somewhat obscured by its 
intimate proximity with human existence. Additional knowl- 
edge about this fundamental human process will undoubtedly 
prove extremely beneficial to man. 

As noted by Beardslee and Wertheimer [3], even though 
ER оп Моне йе Oldest areas! of research, the work 
in perception has not yet yielded a very quantitative set 
of laws, and even though there is an emerging number of 
principles concerning the perceptual process, it is in many 
mays very incomplete. More directly related to the percep- 
tion of sound, Green pointed out that the field of psycho- 


acoustics is characterized by the lack of any integrative 





оре сите топ моі ср to view the rapidly (expanding 
ера бцре" [18]. 

"Тре human ear has been the object of numerous 
шаецца яма expemruimenuslostudiles for Centuries] 
and almost invariable each conceptual or experimental 
advance has put new obstacles in the way of under- 
standing what was once thought to be a simple system. 
A survey of psychoacoustical literature of thes past 
hundred years shows clearly how extremely sophisti- 
бес tThe@avuadicory system isl; and how mew experimental 
facts appear to render the development of a complete 
theory of hearing more remote." [19] 

Ше Of С де ос оо  стопсёро егт елда гг osyohoseoUs- 
tics, Harvey Fletcher, while recognizing the many aspects 
of the perception of speech sounds, divided the principle 
aspects into five categories = the interpretive aspect 
(recognition of sounds), the loudness aspect, the pitch 
aspect, the quality aspect, and the tempo aspect [14]. 
Шпесе groups can also be applied to sounds other than 
Speech sounds; 

The informi aon conveyed ExEsouna. however, gs ordinar- 
т пос transmitted Бу isolatedTsounds, but by a complex 
sequence of sounds. The pattern of changes within a se- 

и сисе то оси чисте he aspects conveys additional 

Ка атпас 1 опа ееси 50ипа 5, спе juxtaposition of indi- 
vidual sounds, or phonemes, creates words, which are grouped 
to form phrases and sentences. Sit tary tm Аа 
sounds, the connection of several sounds of changing pitch 
and tempo creates a melody. While one aspect of the sounds 


may remain fairly constant or simply be repeated, such as 


mae pattern or piteh Changes, r aspects such ав tonc; 





ретро. тое Loudness may undergo changes iso as tomprovide new 
information, rather than just repeating previous patterns 
(e.g. Ravel's Bolero). 

| A review of the literature dealing with the experimen- 
tal analysis and synthesis of sound suggests three general 
types of sounds and sequences of sounds - language or speech, 
Блез Тапа others not fitting thel first two types’. Within 
Sa Co Ue ser three types, Sach of the aspects suggested by 
Шоке Пав been, and as, fertile? areca for investigation 
and experimentation. In speech sounds, the emphasis has 
рвеп оп the quality and interpretive aspects, since the in- 
Poconos 15 Тагрейпу а function of the formant structure of 
the sounds, with secondary information being supplied by 
Cecmeeuaness, pitch, and tempo aspects. Іп musical sounds, 
the emphasis has been on the aspects of quality, or timbre, 
and on pitch. 

The classification of sounds by types and quantitative 
descriptions of the aspects of sounds are somewhat arbitrary 
and subjective. Speech distorted with noise might be clas- 
sified as either E or noise depending both on the 
objective degree of distortion and on the subjective abil- 
ity of a listener to extract the speech information. The 
drums used in African drum language are capable of trans- 
mitting two distinct tones or pitches, which are not used 
ШО transmit vowels or consonants but rather to mimic the 
sequence of tones of well known stock phrases [7]. One 


who is unaware of the underlying language being mimicked 





would classify the sounds as either noise or music rather 
than language. Moorer also addressed the general problem 
И сво shing between sequences of Speech and musical 
sounds [22]. He concluded that the representation of music 
by a type of grammar is similar со representing speech by 
grammar and suggested that this is an indication that the 
Production mechanisms are’ actually closely related. “не 
also made distinctions between speech perception and? the 
Peuceeption Of musTe, nolnting out that mn ®speceh the pitch 
ЕЕЕ little seonscquenee, whereas in music, pivek and 

Пп аге the essence oi the plece. Whilewsueh distine- 
mens may be valid in comparing American music with the 
English language, it does not appear that they are univer- 
Sally valid. Certainly, tHere are some languages, such as 
реге, whene preccbepiays an essential role. Une can 
also find examples of music where pitch plays a minor role 
and quality of tone and rhythm are of primary importance 
(e.g. One Note Samba). 

While a cursory examination of such comparisons between 
Sprech and music might түе спе Ltperrimpressron Chat such 
pursuits have little practical value, additional investi- 
gation and reflection yield more meaningful and productive 
insights and questions. For example, consider the following. 

"The melody sensation seems to be invariant over a 
large class of note-to-sound transformations. Melodies 
can be played on instruments that have quite different 
frequency transfer characteristics, and 56511 рей гесове 
nized. Some instruments produce sounds with a rich 


spectrum comprising the fundamental and many partials 
(stringed instruments); some have little else than 


10 





the bare fundamental (flute in high register); others 

generate spectra having a strong "formant" region 

Nite” result. that. tre? Tower notes usually latk tne 

lower partials, including the fundamental (oboe)." [10] 
ме опе can translatel the pitch of a musica'"Mmelody ата 
Пе сер the melody with a variety of spectrally il ening 
instruments, or with a transformation of the spectral for- 
mant structure, and somehow the human perception mechanism 
Шы не to extract thelinformation about Che melody. Jn 
шосжрегрсерстой о speech, a translation of pitch does not 
prevent a listener from detecting the information, and yet 
a translation of the entire formant structure produces a 
eiiierenc effect. Doubling or tripling the frequency of 
all spectral components, such as by speeding up the play- 
Оо. record Or tape recording, produces less recogniz- 
abolie audio presentations. A similar effect occurs with 
naval divers using a helium-oxygen atmosphere, where due to 
the increased pressure and the change in the chemical com- 
pon of the atmosphere, the frequency transfer charac- 
ЕБС і сз of the vocal mechanism are altered to produce 
wech with transformations of the usual formant structure. 
This produces speech that is not readily understood. If 
me same, or parts of the same, perceptual process are 
mevOolved in both instances, it would be very ane nT CO 
determine why transformations are possible in one case and 
mou the other, and how the audio presentations could be 


altered or the listener conditioned to make both presentations 


equally understandable. 





AS another example, consider the perception of the sound 
Of several speakers, Speaking different words simultaneously. 
When che- -several voices are combined and presented as a 
шепорпопје source, recognition of information become’s diffi- 
мэ прозвао лесе tn muste, however, polypnenics in 
either monaural or stereo forms do not prevent the recogni- 
ПОЛНОГ informations such as melody or instrument tones. Ап 
ес ге Of SpOlypnonsve music ав ар іе To Listen to several 
melodies simultaneously and is also able to consciously 
concentrate on only one of the melodies to a degree not 
w sible in simultaneous speech. 

Birds "produce sounds that appear vo be'more musical 
than speech-like, and yet some birds have the ability to 
Шаша с папай speect.= (Newuranster characceristics of the 
vocal tracts of Such birds are obviously not the same as 
those of the human vocal tract. Comparisons of the formant 
Ст сигез К шщ е попа апа рма вревсп sounds: milent reveal 
different formant structures that are perceptually equiva- 
lent and provide insight as to why. Such investigations 
might be related to ote work пе тас ет Сора аот 
of speech, which is based’ on “a technique of transforming 
multi-formant speech sounds to single equivalent formants 
[©]. 

The communication system used in the perception of sound 


is obviously extremely complex. 
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"The interaction of the physical-acoustic phenomena 
М 121017 обе плтпап imecellect is a complicated one. 
FerTcepulons Of rnytnm, nuance, sound quality, pitcn, 
ete. depend on Several physical parameters in a complex 
Way and are interrelated with the physiology and 
psychology of the listener." [28] 
> JE регһарв, the complexity and the vast number of 
unknowns in the field of sound perception that make its 
investigation both mystifying and interesting. And it is 
the importance of sound in human communications and the 
Similarities and differences in speech and musical sounds 
that make experimentation and investigation in both areas 
worthwhile. NT 
The rapid advancement of computer technology during the 
past decade has provided increased opportunity for applica- 
шээг tne field of sound, so that computers now function 
as some of the most powerful tools for the experimental 
analysis and synthesis of sound. Analysis and synthesis of 
sound are important steps in the investigation of man's 
MET Lon оп соцпа, апа аге prerequisites to understanding 
that perception. In the many areas of sound investigation, 
analysis has attempted to determine a physical description 
све sound, and synthesis has been employed to test the 
accuracy or adequacy of the physical description. Synthesis 
can be used to test the significance or insignificance of 
various parameters of almost any physical description of a 
sound. With regard to musical instrument sounds, Mathews 


and Risset have pointed out that in most cases in the past, 


the synthesized sounds bore little resemblance to the actual 
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tones [24]. This was due mainly to the fact that most earlier 
Шегепрге ас апайтіувіс were directed mainly at a steady ¡state 
frequency analysis, which is understandable in view of the 
less developed technology of the past. Today, however, the 
vastly improved analog and digital tools available have made 
Bor only better steady state but also transient Panalysis 
and synthesis practical, and have opened the door for the 
development of new and better techniques and applications. 
 Банхатріе,; breedman has#presented a technique for the 
analysis of musical instrument tones that is also applicable 
memovner acoustical phenomena such as electroencephalogram, 
electrocardiogram, and geodynamic signals [16]. Slaymaker 
Mas conducted some interesting synthesis experiments with 
ENSIical chords using tones having stretched partials, which 
Eve questioned the adequacy of traditional theories of 
consonance and dissonance. 
1411 of the traditional predictability was gone. 

Mie Сога оше  пссо Mondissonant but strange 

and somewhat eerie. The effect was so different from 

Пе” сепреве -саГӨ сера спһеге уав по сепдепсу to judge 

incCUneneSSwoisour—ot—tTuneness. “IT seemed like a peek 

into a new and unfamiliar musical world, in which none 

сып 116 ОТ О тєрт ес, and the new ones, f*anys 

were yet undiscovered." [26] 

The growing ease of creating and experimenting with new 
scales and tones using computer synthesis may prove To 
accelerate man's musical evolution and to broaden and 
illuminate human perceptual abilities as yet unused. 


Analog musical synthesizers such as the MOOG, the TONUS, 


End сре ВОСПБА ВОХ аге иа сеа зир = роса о OM 
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modern music. Hybrid applications such as Ashton's inter- 
active organ-computer communications network [2] are also 
developing. 

ПЕсевтигеситісцев for сплета па 2019 ПЄ СОЕПТОТОгГ ОГ 
speech [8,20,21,27.] would мм have been possible without 
БЕРІ аірисал апа analog toolslavailaple today. The applica- 
tion of these tools has also shown how the problem of ma- 
imel recognition ofifspelech 1s much more complex than 
originally imagined. Techniques for speech synthesis have 
Пгоргерввес тіп ae Similar manner with the technological 
advances [13,25]. 

While the digital analysis of speech and music has cer- 
tainly come a long way, it does not approach the ease with 
ШОШ Ле human perceptual process analyzes sounds. Апа 
While digital and analog techniques for the synthesis of 
sound can create remarkably accurate imitations of speech 
and familiar musical sounds, the ease of use and the ability 
practically apply these techniques leave a great deal of 
room for development. Additional experimentation with both 
speech and musical ЕТ is required. Hopefully this 
experimentation may provide additional data from which more 
Meaningful and useful quantitative theories of perception 
May be derived; ese theories ў о а recurn 
maitormation leading to newer and improved techniques and 


Seplications. Тї was in this spirit that this work was begun. 


5 





Bee "PURPOSE AND APPROACH 

The goal of this work was to develop an interactive 
hybrid computer system for the real-time definition and 
synthesis of simple approximations of periodic and quasi- 
periodic audio frequency waveforms. Such a system would 
be a worthwhile electroacoustical tool for use in the study 
of psychoacoustical phenomena. A system with an interactive 
mode of operation would allow the user to vary parameters 
псе аца1о waveforms, or sequences of waveforms, and then 
immediately make perceptual observations and evaluations. 

By giving the system a frequency analysis capability, com- 
parisons between changes in the time domain and resulting 
EBusnges both іп the frequency domain and the domain of 
perception are possible. These features would make the 
system not only a worthwhile tool for experimentation but 
also a газа је СОО ТОГ Instruction. 

Another objective of this work was to test some hybrid 
techniques, using the facilities of the Naval Postgraduate 
EsHool Electrical Engineering Department's Computer Labor- 
atory, for generating the sequences of waveforms. This work 
approaches She job of synthesis from a time domain perspec- 
tive. Where the waveforms to be synthesized are simple and 
periodic, such an approach can be more useful than one that 
is frequency domain oriented. Obviously, a triangular wave- 
form might be better synthesized with several first order > 
Segments rather than by trying to provide the individual 


spectral components. There are also some more complex 
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sounds that can be described more easily and meaningfully 

in the time domain. Some musical instrument sounds (e.g. 
organ sounds) can be characterized by a simple periodic 
Камелот. ог carrier, that is amplitude modulated by another 
Биг са Гипссловп. Thesenvelope of The®carrier is apparent 
вом а time domain inspection of the signal but may not be 
so apparent from an inspection in the frequency domain. 
Periodic audio signals that are characterized in the fre- 
quency domain by lower harmonics of small magnitude with a 
Калап Е Structure in the higher harmonics are most often 
par w eqo resulting Írom a filtering process, or a multipli- 
оо n the frequency domain. Some signals of this type 
can, however, be synthesized by translating a formant struc- 
ЕЕ entered around zero frequency to a different center 
Becaumency by a process of amplitude modulation, or 
multiplication in the time domain. 

In general, most synthesis techniques have been oriented 
опата а frequency domain perspective; that is, based on a 
previous spectral analysis, an attempt is made to generate 
a waveform containing Te "important" spectral SSS: 
The resulting digital E Lon of the synthesized signal 
has feta lly Есеп а сесцепсе о equally Spaced Zero order 
Bepments. Another technique, and that pursued in this work, 
is to directly generate an approximation of a time domain 
waveform using a function made up of first order segments of 


Barying length. 
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С. PROBLEMS AND SOLUTIONS 

The technique of time domain synthesis using unequally 
paced first order segments presented several problems. 
ler monotonic function @enerators that were®both ‘easily and 
rapidly programmable by the digital computer were not 
Ке "арте" Therefore one problem wasito find zZ means to 
шт пе Россо Asa ISO Ut TOR Tunesien generators 
for this work were developed using the general purpose 
analog computer components available in the Computer Labor- 
epory Of the Naval Postgraduate School Electrical Engineering 
Department. 

three Ctypeshoie funcyiem penerabors are used in the 
w cem; the primary differences among the three involves the 
EM hods of suppiying inputs to the generators. Іп the first 
type of function generator, one D/A channel is used for the 
segment slope and another for the breakpoint. A slope and 
Breakpoint are transmitted to thevanalog computer and stored 
by analog storage devices. The slope and breakpoint values 
Ки спе пехс segment sre then transmitted over the same chan= 
nels cone channels themselves then act as the analog storage 
devices for the next segment). Thus, when switching from 
One segment to the next, no action is required by the digital 
computer, which has the time between segments to transmit 
mie next segment values. | 

The second type of function generator uses two D/A 
channels for the current segment slope and breakpoint values 


and two different channels for the values of the next segment. 


18 


Eus waencswoitening from one segment to tne next, no 
ЖЕРГІ 5 requared by the digital computer. The advantage 
wens method is that switching is faster because no time 
EN -quired for vine storage devices to track the new values; 
however, two additional D/A channels are required. 

Ine 1.11 гс, урегомм По» 2 еЄёПЄГ ОО ГЄ 50 етог 
each segment is transmitted on a separate channel and then 
meorea by an analog component. The segment breakpoints are 
пеп сгапвтпіссес оп the same group of channels. The advan-. 
mace Ol опа пеипоа 15 спас oncestne function description 
КОО ЛЛ ед to спетапатовр computer, no action is required 
mu nesdregrtcal computer between segments. 

Another problem was the limited number of analog com- 
puter components and D/A channels available. Part of the 
по was the decision to use the three different types 
mie uncetion Бе each of which is used to generate a 
different type of function. The D/A channels and analog 
 бпепгес for each type were allocated on the basis of 
expected function period. less channels and components were 
allocated for the ЕСС O OM UNCL IONS Witm Longer periods 
merce the loneen periods allow analog computer data to be 
transmitted on an "as needed" basis. But, because there 
were still not enough D/A channels for the parallel trans- 
Mission of all the analog information needed, the transmission 
process was broken down into a series-parallel operation, 
sing analog devices to store earlier parts of the transmission. 


Since the number of D/A channels and analog computer 
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 гопепсгв required depends on both the number of function 
 ШЕгасогв and Chel numb of 'segmentistíin a function, a 
decision was made to limit the number of segments іп а 

Ane cion to eight. This decision also involved a compro- 
mise between the storage capability of the digital computer, 
the number of function descriptions (and their sizes) stored 
Nene "a Teital computer, апа the "amount of digital computer 
storage required for the system's programs. 

ien though thesperiods of the functions "generated are 
in the audio range (and usually limited to a maximum period 
of one millisecond), there was still a problem in switching 
Brom one segment to the next. Although the average segment 
time (at a one millisecond function period and eight segments 
per function) is 125 microseconds, individual segment times 
mem be much less —-— at the extreme, a segment with infinite 
slope has a zero time. The general purpose ne computer 
components used for storage and switching from one segment 
mo” the next have С еж гесохџску time? which*must not texceed 
the time between segment breakpoints. Therefore, restric- 
tions (enforced by S digital programs) were placed on the 
magnitudes of segment slopes. 

In the early stages of testing the system, it was found 
шалу transients in the analog circuitry during the recovery 
time often resulted in false detection of breakpoints. To 
Сее Есі problem, заал өт сиет тас а е Vis edo 
able the breakpoint deteetorSeuntil componeny recovery 


was complete. 
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Another difficulty associated with using general pur- 
posse analog computer components is the limited usable voltage 
Кисе of these components. The analog computer available 
(ге Computer Lab has a linear range of -100 to +100 volts. 
Hots, together with the 15 bit accuracy of the’ D/A converter 
placed restrictions on the range of values of segment slopes 
и reakpolmts. These resiirievions are recognized by the 
вузсет' digital programs. When a user defines a function, 
the system checks the definition to insure that the 
a strictions arefnot violated., 

Cons iderat ronskoi technical апа economic feasibility 
have in the past necessitated delegating certain aspects of 
audio.analysis and synthesis to specialized hardware which 
Нето Lled by a digital computer. For example, in speech 
Но 5, 8П electronic model of the vocal tract is usually 
Mmpleomented with special hardware. The model's transfer 
Bnaracteristics are then controlled by a digital computer 
memeenerate the complex analog signals that represent speech. 
Enesrunction generators for this work were developed using 
с ргепегај ригровзе analog computer components available in 
the Computer Laboratory. However, the status of solid state 
EEnology is such that specialized hardware for direct 
пе domain synthesis could be developed. 

mother Significant obstacle to using the technique’ of 
this work is the lack of psychoacoustical data on how much 


approximation is acceptable in the time domain (in producing 
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perceptually accurate or adequate sound). “his represents 
 шіІсеіллес problem; however, the system itself will be 


useful in investigating this area. 
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Іше ЖҮСТЕМ DESCRIPTION 


ШЕ GENERAL SPECIFICATIONS 
ШІ Цсер Oriented 

It was intended that the system developed be as 
mer oriented as practical, within the constraints of the 
Eus U"able hardware, with the objective of enhancing the 
intelligent involvement of the user with the system's oper- 
ation. This required that communications between the user 
moa viessystvem be reasonable rapid and convenient. There- 
fore, a graphics terminal was chosen аз the primary means 
шша арм and output to facilitate operation in a real-time 
interactive mode. The graphics terminal allows inputs to 
Der ecither typed or entered on the terminal CRT with a light- 
wana it displays information on the CRT in textual and 
mmevorial forms. The graphics росе з аата ареоли mel 
Eu irom the point of view of speed and convenience, but 
ED because of its ability to display pictorial information, 
which is O CODEC uall y more informative than numerical 
data. 

A user oriented input language was incorporated to 
make the system's use more convenient and understandable. 
A limited vocabulary of easily understood command words 
allows the user to conveniently instruct the system to per- 
form specific operations. The system converses with the 


user by displaying the possible operations or commands from 
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шанае user may choose, and by prompting the userkko 
respond with an input. 

Ereient utilization of theSsystem required that 
TU be capable of recovery from input errors. Invalid com- 
mand words or numerical inputs outside of allowable ranges 
пио перетоге ignored Dy све system, which does not 
proceed until a valid input is received. 

2. Permanent Records 

While the graphies terminal provides! speed and con- 
Ewenece, it lacks the’ ability to provide permanent records 
femeruture use or study. Therefore, the system provides a 
means for generating permanent and semipermanent records 
Being the line printer, magnetic tape units, and magnetic 
шына. The line printer 15 used to create plots of pictorial 
data (originally displayed on the CRT) and to print tabula- 
pons of numerical ОО ОЛЕ ето. пеш старе апататит агеретр1оуед 
estore a user’s@definitions for later use. 

3. Simple Time Domain Models 

The system uses Simple time domain models of peri- 
odic functions. There were several reasons for this deci- 
Sion. First, seme Signals, or characteristics of signals), 
BES more easily or better described in the time domain than 
ehe frequency domains specifying сбрешеоогачпасе вот спе 
Breakpoints®@r a square or a triangular waveform is easier 
and more descriptive (perceptually) than providing the 
mourier свегіев Гог thes waveform. “Characteristics such as 


attack and decay of musical instrument sounds or the formant 
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Ma jectories of speech sounds are more meaningfully de- 
scribed in the time domain. The system uses simple models 
МЭӨэ-01201-1-020Г Ё1ЕПЧ СОППёсСб Өд straight linessermenve te 
Aro ximate more "complex*time domain waveforms. Figure Mel 
tilustrates such an approximation of a sinusoidal waveform. 
спеше modems are, naturally, easier to describe. Since 
less data is needed to describe them, data storage is more 
economical, data transmission (during the process of synthe- 
sis) is reduced, and data processing time is decreased. 

This facilitates real-time interactive operation. Several 
Signals using different ‘simple models can be connected 
ШЕШ ШШ ГО сгеаСе а Sequence of signals and models can be 
Eu sed together to modulate the amplitude envelope of 
one of them. A final reason for the choice of simple models 
де (Пе limitations imposed by the amount of analog and 

бае Тра І hardware available. 

While it is possible to determine the physical 
meeracy Of approximating a more complex waveform with a 
Simple model, such an То сез пог describe the pers 
ceptual accuracy or adequacy of the model; that is, how 
well or how adequately the simple model imitates the per- 
ved sound of its more complex counterpart. It was in- 
tended that the system could be used to investigate this. 

H. Frequency Analysis 

The system provides a limited degree of frequency 

analysis of the signals created with the models defined by 


the user. This allows the frequency spectrum to be related 
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сре аџацо presentation of the synthelsized signal, ana Xs 
meovides a tool for cemparing changes in the time domain 
p-smamnceens with the corresponding changes that occur in the 
frequency domain. 
5. Signal Output 

The actual synthesis of the signals is accomplished 
шаю ся апа ов сори Under Lhe control of the digital 
computer. The analog voltage representing the signal out- 
put 1s available for viewing on an oScilloscope or for con- 
nection to an audio amplifier (for immediate observation) 
or to a tape recorder (for a permanent audio record). Minor 
changes in analog computer components allow time scaling of 
the signals to facilitate analog plotting of the signal out- 
put and allow major changes in the dynamic range of signal 


parameters. 


B. SYSTEM COMPONENTS 
1. Major Hardware Components 

The major components of the Electrical Engineering 
Department Computer Laboratory that are used in the system 
are briefly described below. More detailed information may 
шаве гоц “арке ст 

а. XDS 9300 

The XDS 9300 is a high-speed, general purpose, 

ШЕсісаі computer with ze ra 5 mierosecornd суие ае 
uses 24-bit words and has a 32K word core memory. It is 


supported by a magnetic drum with a 524K word capacity, two 


28 





magnetic tape units, a card reader, a high-speed line 
Mater. anda deletypewriter. 
b. COMCOR CI-5000 
The COMCOR CI-5000 is an analog computer with a 
large selection of analog elements and a full complement of 
e ital Logic: 
с. ADAGE AGT/10 
| The ADAGE AGT/10 is a small general purpose 
digital computer using 15-bit words with an 8K memory. 
КК ЕЛП С песе гип five со SixXemieroseconds. The 
AGT/10 incorporates a cathode ray tube (CRT) for the display 
F phicshand text, and is further supported by a 
teretypewriter and a magnetic disc for secondary storage. 
саст асе 
The three major components above are interfaced 
by a high 24%; qata channel and conversion equipment. The 
transfer rate is 250,000 words/second to the XDS 9300, and 
160,000 words/second from the XDS 9300. 
D Software 
a. Language 
| The programs for the system were written pri- 
marily in XDS FORTRAN IV, although some of the programs con- 
tain a mixture of FORTRAN and assembly language, which is 
permissible in XDS FORTRAN IV. Assembly language instructions 
were incorporated primarily where speed of operation was 


mensidered critical to the operation of the system. 
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D Segmentation 
на пеш "= про лог the system's digital pro- 
Биг гт exceeded available core’, the program was segmented and 


overlayed as shown in Figure II-3 below. 


fae COMPOSITION OF SYSTEM AUDIO OUTPUT 

шас) зве ракеце спе ало О рот the system is de= 
scribed. The output consists of a sequence of user defined 
ШИИ лазы. Basically, each ¥stenal consists ofa periodic wave 
metion, analogous toia carrier; that is amplitude modulated 
 Ггесцепсу повспитатсес by other functions. The duration, 
ee litude, and the frequency of the periodic wave function, 
EN !! as рекоше иок касе аге defined by. the User. 
The amplitude and frequency modulation functions, and their 
maerods, arevaliso Gelimedeby the user. Individual signals 
Eu пеп јопва те тог agsimele пали sequence. Ор бо 100 
subsequences of the main sequence may be joined in any order 
and synthesized. 

1. Klemen’ Tyues 

There are eight types of elements. The elements of 
any E. суре уи етигстиапенве шетел е сопе га теа 
Fommon general form. individual signals are defined by one 
element of each of the types. The element types are 
Besopribed below and summarized in Table 11-1, 
а га! 
The elements of this type are used to specify 


the time length of a signal. 
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FIGURE II-3 


(Segment A) 






MAIN 


PROGRAM SEGMENTATION 


(Segment C) 

















EN Lab 
DEFINEG 
COMMENT 
STORE 
51 GOUT 
CLEAR 
SIGDEF 
INUM 
SHOSIG 
OUTIN 


BEREG 


(Segment D) 


ERESPEC 


(Segment Е) 
PTINTET 


TAPEDRUM 


FIX 


31 


(Segment 


ТРО 












b. Amplitude 
The elements of this type are used to specify 
moeerelative audio strength of a signal. 
сл BerionäczWave Function. Amplitude, Modulation 
munctvion, and Frequency Modulation Function 
The elements, or the functions, of each of these 
ШІРрес аге made up of eight connected straight Pine segments. 


шае functions conform to the following form. 


со 


f(t) = ec + 2 a, * Lt-d, JLU(t-d,) - U(t-d. 


) ] 
i=] Fl 


ШІгге T = period, d. = 0, d, = T, d. 


| 9 al 
Mit step function. An example is shown in Figure II-l. 


< а +1 апа 0 = the 


Мэс functions are defined and stored in a non-frequency, or 
Gime normalized format. 
Qu Frequency 
lhe elements of this type are used to specify 
the frequency of the periodic wave functions. 
e. A.M. Function and F.M. Function Time Scales 
The NA of the elements of these types are 
specified at the time a signal is defined and they are used 
to specify the relative frequencies of the A.M. function 
ШОО Сре I .Maiunction of that signal: 
2. Maimpsi gnats equence amen. не ВЕЕТ НЕОН 
The main signal sequence consists of one or more user 
defined signals, each described by the eight element types 


previously discussed. As each individual signal is defined 
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не user, it IS placed alter the pre зт ати о OPI 
one les mati sequence. From this main ‘sequence, a part 
(or subsequence) or parts (a group of subsequences) may be 
selected for synthesis. 

There are two ways in which the actual definition 
а signal may be. made by the user. Tbe first way is Dy 
specifying one of each of the types of elements. The second 
ЕРЕШЕ! Оу зреслгушта less" tren elebt” of” tae element types. 
иоле second way Is used, the system assumes that the 
EXEEments ot theNbypes Nou Speciiied are to be continuatnions 
шашсоріісасе5 оі the corresponding types! of the previous 
Signal synthesized. 

There were two reasons for incorporating this dis- 
pinetion into the system. First, it reduces the amount of 
data that must be entered and stored to describe a signal 
when some of its elements are the same as those of the pre- 
vious signal. Second, when the element type continued is 
one of спеть атточ5 that element to continue 
ininterrupLeg Posi оцон епа е пе 

E Subsequence Group 

When the user elects to execute the actual synthesis, 
be may specify up (и zsubseauenessgrarzche marnzsequenees 
The subsequences will then be synthesized in the order spec- 
led. Thus a long stringfofrsignalseshichnatiha as repeatine parts 
may be created at execution time without the need for re- 
peating the definitions of the duplicated parts in the main 


sequence. The grouping information is not stored permanently, 


34 





| певетоге, cach time the synthesis is executed, 


the grouping information must be respecified. 


D. FREQUENCY ANALYSIS 

her computing the frequency spectrum of the periodic 
wave and the A.M. functions, an FFT (fast Fourier transform) 
Ex ОЛЗ ог the diserete Fourier transform is utilized. 
шацца ЕНЕ Іппсілопв Used are considered to be periodic, 
their Fourier series expansions are of the form 


/ 


КБ) = 2 с(п) ехрі2ті(тс/тТ)| 


n=—c 
where the с(п) аге given by 


T 
mem) = 1/1 J x(t) expl-2ri(nt/T)] dt 
0 
ENS 1s the period of the function. 
The function x(t) may be sampled at N equally spaced 
points between O and T to generate the sequence x(jAt), 


mere At = Т/М. The equation for the sampled function is 


then 


N-1 
6015? 


c (n) exp[2Ti(nj/N)] 
n=0 р 
Using the properties of the discrete Fourier transform [10], 


it can be shown that the function x(jAt) has the finite 


Fourier transform c tn), where сь (п) is given by 
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eg (n) = etn + Nk) 

amic срезехась Mourier series in ianfinitte, it песе 
essary to make М large enough so that the aliasing error 
introduced by approximating c(n) by со (п) js reduced to an 
acceptable level. When this is done, then c (n) eu cr 
ДИС! 11,2,3,....,Х/2. 

Ав discussed in Ref. 6, the errors that are possible in 
шаша tine the discrete transform are those que to aliasing, 
those due to the finite precision of the computer, and "leak- 
mee errors. An accumulated computational error occurs in 
eeoluating the transform due to the imprecision with which 
the data and the intermediate computational results are 
mepresented in the computer. Reference 17 explains that this 
ОГ us significantly reduced by the utilization of the 
mel and floating point M eT the FFT algorithm computes 
phe discrete Fourier transform using only 2N log, N opera- 
Dons, rather than.the Nî operations previously required 
the direcinevatuation of the disicrete Fourier transform. 

As discussed in Ref. 6, if the sample period of the 
function being transformed is truncated in Ni a way that 
it contains cisoidal components that do not repeat an 
Envreeral number of times in the sample period, or are dis- 
continuous at the end of the sample period, a "leakage" 
бог will occur in the frequency analysis. 150:5 problem 


can occur when using the system to find the spectrum of a 
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periodic wave function amplitude modulated by an A.M. func- 
meron when the ratio between the periods of the two functions 
Kul an integer value. 

To generate samples for the FFT, the system uses the 
Poordinates of the breakpoints of the segments! of The 
ШЕБІ Со calculate’ the Slopesof eachiseement. It then 
calculates function values between the breakpoints. When 
ENnsele&funetion is$to be transformed, 512 pointszare used 
in the sample period. When the transform of a periodic wave 
тон иаа рва by an A.M. function Xs*to be calculated, 
Dae periodic and A.M. functions are sampled individually, 
the samples are multiplied, and the transform is then taken. 
This eliminates the need for a complex convolution in the 
frequency domain. For this case, a sample size of 1024 is 
пева. 

Ап important determination in the application of the 
discrete Fourier transform is that of the sample period. 
This does not present a serious problem when the signals 
being considered are steady state or when the spectral sta- 
ENSEtIcal properties of toe Signal are reasonably constant 
over a determined sample Tod (and the average spectrum 
is what is sought). However, where the various spectral 
memponents change with time, this can be a serious problem. 
When the signals represent sound, the О із even greater 
because the Fourier analysis must have meaning with respect 
bo the perceived sound. In sound, one is often interested 


in how the frequency spectrum changes as a function of time 
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(with a particular sample period). Until more is known about 
pacaprocess of human perception of sound, this will continue 
pube an area for investigation. 

While frequency analysis was not intended to be the 
water purpose of Chis work, tne problem described above was 
recognized. The system's programs do allow the user to 
set the period over which a signal is analyzed so that changes 
maeperiod can be related to changes in spectrum and changes 


moe perceived sound. 
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T 5 О ТЕМРОРЕЊНАТТОМ 


— 


А. SYSTEM COMMAND LANGUAGE 

Ene usersconveprsesewritborhe System, via ther praphics 
merminal., by TET system command words. The system 
Шпзрјауг а list of alternatives from which the user may 
 оове and prompts the user to indicate his choice by en- 
tering a specific command word followed by a C/R (carriage 
return). The system then responds by either performing the 
Mmdalcated operation or by providing additional directions 
Gomcvhe user and requesting additional inputs. Command words 
that are not a part of the system's vocabulary are ignored. 
All data is entered by the user in integer format and ter- 
minated by a comma and a carriage return; decimal values 
must be multiplied by a scale factor (given by the system 
during use) to make EROS valued. 

The operation of the system can be best explained by a 
discussion of the consequences of entering specific command 
mores. Inivielly, ume user is presented with a display of 
primary operations and is asked to make a choice. The re- 
sults of choosing each of the primary operations is discussed 
below. Іп each case in the following descriptions, command 
werds and other parameters are entered by the user av the 
explicit direction and guidance of the system. То terminate 


an operation, the user enters the special command word END. 
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ШІ Element, Der ine 
The system responds by displaying a list of five 
types of elements the user can predefine (periodic, A.M., 
F.M. functions, amplitudes, and frequencies) and requests 
ohe user to choose! one of the types. 
ar. >kunetions 

Шил 12 Wwpe@chesenzus7onezerzthe „Sumetions 2 the 
system asks the user to specify the number of the element 
(0 through 9). When a valid number is received, the system 
шир ам The function selected’ and asks the user whether he 
peshessto modbey the function by using the light-pen or by 
typing the coordinates of the breakpoints of the segments 
сре function (initially the functions are initialized to 
the pseudo-sinusoidal waveform shown in Figure II-1). The 
user responds by typing a T for typed input, an L for light 
ШЕП прис, ог а C/R to erase the display and select а dif- 
ferent numbered element. When typewritten input is selected, 
the system displays the X and Y coordinates of the function 
segment breakpoints along with the graphical display of the 
function and prompts diu Use to input the Е of 
each breakpoint. As each X and Y value is typed, the coor- 
dinate list and the function-display are updated (if the user 
does not desire to change an X or Y value, he may type a C/R 
and the system advances to the next value). If, in the pro- 
cess of modification, the user wishes to copy the displayed 
values of all remaining X and Y values, he types the letter 


B. 
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Woerthe musen Nas Completed the definition, the 
system examines the definition for errors (such as segment 
slope.magnitudes outside of allowable ranges). If errors 
 ейсегессей, the system restores the original function and 
fic user must reenter his definition. If no errors are de- 
ресгей, the system normalizes thegX values of the function 
so that the largest is 1000 units. The user also has the 
гісі to normalize®the Y values. 

ALEChiIsspoint, vne wser may change’ his definition 
wenan typing T or L aS discussed before. 

b. Frequencies 

Wines ch omo ner уре or element 2s®chogen , 
ШПЕ user is presented with a display of the current values 
Eu the 72 frequency elements and is prompted to select one 
ог the elements and then enter its new value. As each of 
the frequency elements selected Wstdefined, the display is 
ссе апа сие users requested to select another element. 

с. Amplitudes 

The process Oredet ining, or changing, amplitude 
elements is similar ЁО that of the frequency elements, 
except that the current габ а are not displayed. 

2. Find Spectrum 
The system responds by asking the user whether he 
wants to find the frequency spectrum of a single function 
or of a periodic wave function amplitude modulated by an 


AM function. Depending on his choice, the following occurs. 
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4. singles Function 

Frompved™ bywthe@system, the wser then chooses 
either a periodic wave function or an AM function and spec- 
ifies an element number (0 through 9). After valid inputs 
mecereceived, the system calculates the magnitude and the 
mmases Of the discrete) frequency spectrum. The system then 
asks the user how many values, or points, of the calculated 
spectrum he wishes to display (he may choose between 5 and 
399 points). A graphical display of the spectrum is then 
presented on the CRT. If the function being analyzed is 
considered to be periodic, each spectrum value displayed 
Borresponds to an harmonic of the function, with the first 
Pee ecorresponding to the dc component. Being able to 
specify the number of points of the spectrum to be displayed 
is useful when the relevant information in the spectrum is 
concentrated in the lower harmonics. If the total calculated 
Ember of points were always displayed, the significant 
information might be bunched so closely in the display that 
it would be too difficult to view. 

(1) Options. The user has several options in 
finding the frequency а of functions. By following 
stem direction he may set the period over which the func- 
tion is analyzed to a value less than a full period of the 
function. He may also set the period of analysis equal to 
meee period of the function, but truncate the function at a 
point less than a full period. A combination of these 


options is also possible. 
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(2) Plot. After a display of the frequency 
w erum is presented, the system asks the* user if he wants 
time printer plot of the spectrum magnitudes being dis- 
played. A sample plot is shown in Figure 11-2. If the 
user elects to simply continue, the system again asks the 
user how many points are to be displayed. 

be Product soiree kwo Functions 

The system asks the user which periodic wave 
function is to be modulated by which AM function, and the 
о between thei two. Operation theneproceeds ав for 
single functions. 

ee Define Signal 

The system responds to this choice by presenting 
we description of the last signal defined on the left half 
of the CRT and a list of the eight element types to be spec- 
ified for the new Sone Оп ле Puente half of the CRP. The 
ser may specify each new element in one of four ways. 

In the first way, the user specifies the element by 
its number (if it is one of the predefinable types) or by 
its value (if it is ц AM or FM time scale or duration 
element). | 

In the second way, the user types a C/R. When this 
curs, the element is assumed to bela continuation of the 
corresponding element type of the previous signal. This 
makes specification of the new signal relative to the pre- 
vious signal, and changing the previous signal would also 
change the new signal. During synthesis, it is relative to 


the previous signal synthesized. 
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In the third way, the user types the letter R and 
me system copies the» specification of the corresponding 
element type of the previous signal defined. It often is 
easier to type an R than to type element numbers or values. 
Once an element is specified in this way, changing the 
previous signal will have no effect on the new signal. 

The fourth way is by typing the letter C. It is 
equivalent to typing a C/R for all element types not yet 
e ecified for the new signal. 

When all of the elements of the new signal have 
been specified, the new signal definition replaces the old 
display on the left half of the CRT and the user is invited 
шааегіпе another signal. 

4. Delete Signal 

This choice is used to delete a signal from the 
main sequence of user defined signals. The user is asked 
to identify the number (within the main sequence) of the 
signal, and the system responds by deleting the signal and 
decrementing the numbers of all successive signals by one. 
The system then tes the user to select another signal. 

5. Insert Signal 

This choice is used to insert a new signal between 
two previously defined signals in the main sequence. Follow- 
MENS ysTem directions, the user identifies the old signal 
after which the new signal is to be inserted. The old sig- 


nal is then displayed on the left half of the CRT and the 
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user defines the new signal to be inserted in the manner 
described under Section III-A-3 (Define Signal). 
6. Display Signal 
The user identifies a previously defined signal 
and the system responds by displaying the element speci- 
mecation of the signal on the CRT. The user is then 
ШИТІ беа to identify another signal. 
ieee Print 
When this choice is entered, the system responds by 
displaying a list of secondary choices. . The results of 
selecting each are discussed below. 
а. Ар Рат ес Print 
When one of these choices is selected, the 
system produces a listing of the values of the elements of 
рпе type chosen on the line printer. 
DE Sig seqn, Print 
This choice is used to obtain a line printer 
ШЕ пг ог the descriptions of one or more of the signals 
in the main signal sequence. The listing is produced after 
phe user inputs the first апа саз лшитев ла 5 Wiese dde aros 
are to be listed. 
с. весло 
The last four secondary choices are used to 
obtain line printer plots of any of the eight-sement func- 
bons. The last choice is used to obtain plots of a peri- 
odic wave function modulated by an AM function. Sample 


plots are shown in Figures III-1 and III-2. 
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8. Store 
The Store command is used to transfer user defini- 
tions of signals and signal elements to the magnetic drum 
for semipermanent storage. Space for 25 files, or 25 sets 
of user definitions, is reserved on the drum. After the 
user specifies the file number, the system writes the in- 
formation on the drum without removing it from core, and 
then returns to the list of primary operations. The file 
may be recalled later or transferred to magnetic tape. 
О. Recall | 
This choice is used to recall all or part of the 
user definitions stored in one of the previously discussed 
files on the drum. The user may recall the main signal 
sequence or any of the element definitions stored in the 
mete DY following system directions, and could select dif- 
ferent element types from different files and then store 


a 


the combination in a new file. 
ВО. Таре 
Тре Таре command is used to transfer the files of 
user definitions on Te drum to permanent storage on 
magnetic tape. | 
11. Drum 
This command is used to read files stored on 
magnetic tape and transfer them to the drum. 
Па, Ехестре 
The Execute command initiates the actual synthesis 
of the user defined signals. Any number of the following 


options may be typed next. 
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а Rice 
ы сера опште Ооо реза. а Тісбіпог the main 
Sequence numbers of the first and last signals of each 
Bubsequence is written on the line printer. 
b. Last 
Ordinarily when the last subsequence of a group 
mesmocen synthesized, the entire group is repeated until the 
user halts the synthesis process. However, when the Last 
option is specified and when the last subsequence has been 
ЕЕ 12еа, оп1у the last subsequence will be repeated. 
С. Вегасе 
When a group of subsequences has been selected 
meee synthesis and the Alternate option is specified, the 
КЕ subsequence of the group is alternated with each of 
the other subsequences during execution. For example, the 
last subsequence may be one in which the functions of all 
of the signals are not directly specified (but are continu- 
Bons of the functions of a signal in a different subse- 
quence). The other subsequences could consist of only one 
ны гасп, With thesfunctions directly specified. “Три 
would result in the synthesis of several sequences (each a 
combination of one subsequence and the last subsequence) 
that were the same except for the first signal and the 
Functions. 
а. Envelope 
During the synthesis process, the AM function 


MS ordinarily treated as thoughts pertodie cher жр 
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ШЕП (Пе last segment of the function has been synthesized, 
ШЕР зупбһевів then restarts with the first segment again. 
u= ver, if the Envelope option has been specifted, the 
slope of the last segment of the AM function is maintained 
ис] а пем signal.is begun. 

US Te 

When this option has been specified, the AM 
Bonetion is initialized for each signal during synthesis. 
This option is useful in the synthesis of musical sequences 
where it may be desired to have each signal represent a 
note of a melody, and to have the AM function simulate the 
attack and decay characteristics of a musical instrument. 
Bene -chis option, it is unnecessary to specify an AM func- 
ПО or each signal during the signal definition process. 
chat is required is to specify the AM function for the 
first signal of LUN Сү Munetron" weuld-cbe used 
and reinitialized for each signal during synthesis until a 
new AM function were specified in the sequence. 
ES. Comment 

The purpose of this Шшистсс 2 allow thewuscr TO 
Record comments сотне printer? which 15 useful “Wn 
making notes concerning the other material being printed. 
The Comment command may be used at three places in the pro- 
gram - when the list of primary operations is displayed, 
at the list of secondary choices obtained by entering the 
Print command, and at the option list obtained by entering 


the Execute command. After the Comment command has been 
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шесеттуеа, еасћ line of text entered on the AGT typewriter 
momoransterred to the line printer, with three texceptions. 
fen the word TOP istentered as*the! first word of a line of 
text, the line printer will skip to the top of a new page; 
when STAR is entered, a row of asterisks is printed; when 
END is entered, the Comment operation is terminated. 
14. Clear 
ће Севр оштар сс емесазе the main fsi grial 
sequence when deletion signal by signal is inconvenient. 
15 Step 
This choice is used to define a group of ten fre- 
quency elements, whose successive values increase by a fixed 
Enerement according to the following formula. 
Е, = эж ца а20,1,2,2....9. 
16. Octave 
This choice is used to define an octave of frequency 
elements according to the following formula. 
E феа, Ee OF 0 
When the value of D is 12, an equally tempered musical 


scale results. 


fee DATA STRUCTURE 
The purpose of this section is to briefly outline the 
manner in which the digital computer program handles the 
data to be used by the analog computer Annie 
1. Element Type Data 
For each of the function elements (periodic wave, 


AM, and FM functions), two arrays of eight words each are 


ЭШ 


reserved. One of these arrays is used to describe the 
Mes Of the’ cight segments oi the function; the other is 
esed CO describe the eight breakpoints. The first 15 bits 
Шо еасп word specify the analog value to be transmitted to 
Mie sanalog computer; the last nine bits identify the channel 
лег Which the value will be transmitted. Since the digital 
to analog converter eventually requires the data to be con- 
ей (0 Lis format, processing during synthesis is reduced 
computer core iis conserved by storing it in this form 
initially. The data for the other signal elements is stored 
asimilar format, except for the duration elements, which 
are not converted to analog signals but are used in a digital 
Form. 
Ea Main Signal Sequence Data 

An array (ISIG) of 1000 words was reserved for the 
Mescription of the main signal sequence. At the bottom of 
the array, each word corresponds to an individual signal 
and is used to partially describe that signal and to point 
to additional descriptive information. Words at the top of 
the array contain e топла: descriptive бога сох 

To illustrate how this is done, refer to Figure III-3 
and to the following example. The first twelve 1 
word number one are used as a pointer to the start of addi- 
tional information about signal number one at the top of 
Bue array. In this case, the value of the pointer is 
(1750). = (1000). | . The last eight bits of word number 


one indicate which of the eight element types have been 
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ВТООВЕ ТТТ-3 


Га ата [= та Sample Data 
















1 | (1000). (377). Bottom of the Array 
2 | (0992),, (010). 
з |00991), (157), 
992 Frequency Element #22 
993 Duration = 3000=ms 
994 EM ше саен 2500 
995 AM Time Scale = 5000 
996 Amplitude Element #7 
po Frequency Element #41 
998 FM Function #3 
999 AM Function #1 
1000 Periodic Wave Function #5 
(Б) Binary Form of Word Number One 
| 0 | lale 16 23 
EE EEE 
POINTER 


Б АТ Т (а аа а аня 
EM TIMES CALE BIT =- ee O = 

AM TIMESSCALE BID -M ээ. 

AMPLITUD ра | | | 
FREQUENCY BIT TRES RE а men en _ Мм. 

ЕМ FUNCTION Bim A За 

AM FUNCTION BIT эээ ЭЭГ эээ... 
PERIODIC WAVE FUNCEION BITEME ee eee 


Эв 





defined for signal number one. A one in bits 16 through 23 
indicates that the element has been defined; a zero indi- 
eates that the corresponding element of the previous signal 
Synthesized is to be continued. For signal number one, all 
eight elements have been defined. The number of one-bits 

in bits 16 through 23 also tells how many words at the top 

of the array are associated with the signal, with the pointer 
fmeecmoliying the itrst of these words. 

Шо Contanue thewexampie, word number two points to 
Ecxnfoprmation at the top of the array describing signal 
 шЦцер two. Only the frequency element of signal number 
ШОУ ters from the elements of signal number one. Thus, 
уа = псје bit of the last eight bits of word two is a 
one, and the pointer points to the word at the top of the 
array which identifies the new frequency (word 992). 

From the description above, it can be seen that the 
Maximum number of signals that the main sequence will con- 
MARIA dis not fixed, but depends on the sum of the number of 
elements defined for the individual signais. 

Jusepriorzreozene actual synthesis of signal number 
one, the 22572777 in word number one is unpacked and used 
to locate the description of the elements of the signal. 
When the description has been located, the actual analog 
Maliues fully describing the elements are retrieved and are 
placed in special arrays to be used by the digital to analog 
converter and the data channel. To accomplish the actual 


Bonversion and transmission, these special arrays are 
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ео бо the converter with special assembly language 
instructions [31]. | 

While signal number one is being synthesized by 
poee analog computer, word number two of ISIG is unpacked 
and processed in a similar manner. When signal number one 
ends, signal number two is converted and transmitted. Then 
sonal number three 15 mrocessed, etc. Additional information 
describing the synthesis process is contained in Section IV 


En the computer program. 


£ 
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ТУ. ANALOG COMPUTER CIRCUITS 


A. FUNCTION SEGMENT SLOPE SWITCHING 

Refer to Figure IV-1. The eight segment slope values 
of the normalized periodic wave function are transmitted by 
the digital program to terminals T420 - T427. Each slope 
value is attenuated (by 50%) by a potentiometer to reduce 
се рис transiénts and is then fed to a digital-analog 
Mitch. The top four switching components shown are СОМСОН 
aiplifiers specifically designed for switching; the bottom 
шаша Swivches are combination summer—-integrators used as 
switches by patching the inputs to the IC (initial condition) 
terminals of the integrators and deleting the integrator 
feedback capacitors. Switching is effected by means of the 
BESSER -eompute mode controls. An end-around shift register 
(Figure IV-8) is used to switch in one segment at a time to 
Mate the function. The normalized function segment 
Ме Values may be further attenuated by potentiometer 
РЦ07 before being sent to M003 where they are multiplied 


by the composite frequency signal (see Figure IV-4). 


В. FUNCTION SEGMENT BREAKPOINT STORAGE AND SWITCHING 

The breakpoint values of the segments of the normalized 
periodic wave function are transmitted to terminals T420 - 
T426 by the digital program and are attenuated (by 50%) by 
potentiometers (see Figure IV-1) and then fed to track-hold 


networks (refer to Figure IV-2). The top four track-holds 
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EHown 1n Figure IV-2 are COMCOR components specifically 
mestened for that purposes the bottom three’ are integrators 
Used as track-holds by patching the inputs to the initial 
condition terminals of the integrators. Both types of com- 
monents function equally well but require different logic 
лоша to perform the “rack and hola functions, The break- 
ДК ог the Cighthescement as) zero and requires ino input. 
The breakpoint values are tracked for approximately 500 
microseconds and are then held. Storing the breakpoint 
values with track-hold networks allows the same terminals 
(T420 - T427) and potentiometers to be used for both the 
slopes and the breakpoints of the function segments. This 
economy was necessary because of the limited number of 
Baannels in the digital-analog converter. 

The breakpoint values are switched into the function 
generator circuit (Figure IV-4) one at a time by the digital- 
Euadog switches, which are controlled by the end-around 
shift register mentioned in the previous section. The 
Dreakpoint values can be further attenuated by potentiometer 
EUM. which functions as a time scale adjustment. Increasing 
the amount of attenuation increases the frequency of the 
meamecrated function and decreases its magnitude. ¿The output 
of P411 is then applied to the function generator circuit 


(Figure IV-H). 


C.  PERIODIC WAVE FUNCTION GENERATOR CONTROL LOGIC 
Refer to Figure Iva 58 20 2 со ст сг По eS TD ODE 


of the periodic wave function, the digital program transmits 
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m zero іоріс signal to 7022. This puts the track-hola 
networks (A014, А024, А034, А042, 4031, А037, апа A045) in 
the track mode and causes DF12 to generate a pulse to reset 
the shift register. A031, A037, and AO45 are combination 
summer-integrators used as track-holds, which accounts for 
the difference in logic signal between them and A014, A024, 
A034, and A042. The breakpoints are then transmitted. The 
pulse generated by DF12 is long enough to insure that the 
track-holds have tracked the breakpoint values. The program 
tests T133 to determine when the tracking is complete. When 
it is, the program tests T136 to determine when the track- 
holds have switched to the hold mode; DF13 generates a short 
we to allow the transition to the hold mode. When the 
wmode isl detected, thessiopes of thegsepments of the 


periodic wave function are then transmitted. 


D. PERIODIC WAVE FUNCTION GENERATOR 

Refer to Figure IV-4. The normalized segment slope 
values of the periodic wave function are fed to multiplier 
bee, where they aresmultiplied™ by the composite frequency 
Penal from A011 (Figure IV-12). A025 integrates the output 
of M003 to generate the segment. Unlike the FM and AM func- 
Gon generators, the periodic wave function generator com- 
pares the "X" (or time) value of the segment with the 
corresponding breakpoint value to determine when the segment 
breakpoint has been reached. This is accomplished by inte- 


grators A057 and A061, which integrate the frequency signal 
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FO. generate a ss timing voltage, whose value is pro- 
и опа to the "X" valüerof the periodic wave function; 
БИ ше о Жо ре тата voltage l1sp determined by the їге- 
спа Only one of the timing isignal integrators 
EN -ес паста time, cach integrator being used on alternate 
cycles. This toggle arrangement was necessary because of 
the time required to reset an integrator at the end of a 
cycle (one integrator is being reset while the other is 
being used). Switches A063 and A065 are used to isolate the 
АЕ а ог being reset. For the first seven segmentis of the 
function, the timing voltage is compared with the breakpoint 
а цдез in either comparator Cll or Cle to determine when the 
Beeakpoint has been reached. When a breakpoint is detected, 
mae values of the next segment are switched into the 
generator circuit and the old TUTO are disconnected. 

fis тесп nea  рэгасЄТү gencraved viming 
саге provides Те positive control over the output voltage 
Ж ИЛС25: without some control, a small bias or noise at the 
Ирас of A025 would cause the de value of the output to 
drift over a number of cycles, and eventually A025 would 
E "od. Therevercs to provide control over the output of 
A025, the "Y" value, rather then the "X" value of the eighth 
breakpoint of the function is used for breakpoint detection. 
mce the "Y" value of the eighth, or last, breakpoint is 
always zero, each wave period is automatically compensated 


шог any dc drift. 
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E. TIMING SIGNAL GENERATOR LOGIC 

Reter vo Hipure 1v=5. Bach time the slope and break- 
Нэг valuesfor the first segment of the periodic wave 
mmeciOneare Switched into the function generator circuit, 
the input to N124 (from the shift register of Figure IV-8) 
causes the outputs of D05 and D15 to reverse states. As 
Хасе Спе сітсиіс is not disabled by a zero input from 
204, DOS and D15 are always in opposite states. The circuit 
is used to switch between the timing voltage generators 


of Figure IV-l. 


E. PERIODIC WAVE FUNCTION GENERATOR BREAKPOINT DETECTOR 

Refer to Figure IV-6. For the first seven segments of 
Ererunetion, the function timing signal is compared with 
Dae negative of the segment breakpoints in gponparavtoprsgClu 
or C12 (the upper half of the circuit is disabled by a zero 
ош from FF08). When a breakpoint is reached, the output 
of N422 changes from a logical one to a logical zero; the 
Same change of state occurs at the output of Nl27. The 
Ш ЕПС of N12/ is fed to the pulse generator circuit shown 
in Figure IV-7. 

For the eighth segment of the function, the lower half 
ОҒ the circuit is disabled by a zero signal from FFOS' 
(other zero inputs to N422 will also disable this part of 
the circuit) and the upper half of the circuit is enabled. 
The upper half (C06, C14, N207, N212, and N412) is used to 


determine when the function value reaches zero (the 
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breakpoint of the eighth segment). Its Opemmabt longus 
meceribedein the’ section explaining the operation of the 
breakpoint detector of the AM function generator (Figure 
ІУ-10). 

МнепбзПе analog computer istin the reset mode, awsienal 
from R1* (through N202 and DO4) disables the breakpoint 
detector circuit and places integrator A025 in the reset 
mode. Тре same thing 1s accomplished by the digital program 


Beesending a zero logic signal Со 1021. 


G. SHIFT PULSE GENERATOR 

Refer to FigurefIV-/. Each time the breakpoint of a 
Segment of the periodic wave function is reached, the 
breakpoint detector triggers delay-flop DF06, which gen- 
(ес а 15 microsecond pulse that is fed to the segment 
shift register (Figure IV-8). The circuit also serves two 
other functions. First, it feeds back a signal (from N106) 
to the breakpoint detector to disable it during switching 
from one segment to the next and long enough for the detec- 
tor comparators to recover. This was necessary to prevent 
false triggering Soltmunceagctecper.. Experimentally wt wes 
determined that a minimum of about 65 microseconds was re- 
шара Тог Chis. m Second, an additionalmdeiay 15 required 
to allow the delay-flops to recover; a minimum of 10 micro- 
seconds delay after the output of the delay-flop returns to 
zero is necessary. To provide these delays and to prevent 


false triggering, three delay-flops were used. Their timing 
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is shown in Figure IV-7. The pulse from DF10 overlaps that 
око to Maintain а continuous zéro outputeat N106 for 
the minimum 65 microseconds and is necessary because of the 
transient that may occur when DFO6 and DFO7 change state 


together. 


He SEGMENT SHIFT REGISTER 

Refer to Figure IV-8. The periodic wave function seg- 
ment shift register is used to control the connection of 
ШІС segment slope and breakpoint values to the function 
 Егасог сігецісг. A signal from DFl2etinitially sets the 
ENS: Dit of the shift register and resets all others. With 
only the first bit "on," only the values of the first segment 
E connected to the function generator. Whentthe breakpoint 
"сре first segment 1s reached, the breakpoint detector 
and pulse generator circuits (Figures IV-6 and IV-7) gener- 
Mme a pulse that shifts the "on" bit to the second position 
Ache shift register; disconnecting the first segment values 
aña connecting the second: The output of the last position 
DÍ the register is returned to the register input to provide 
round shifting that makes the generated function 


periodic. 


I. АМ FUNCTION GENERATOR 

Refer to Figure IV-9. The analog signals present at 
T431 and T407 are the slopes of the alternate segments of 
the normalized AM function. At T430 and T406 are the 


corresponding values of the breakpoints. The initial value 
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of the function appears at T432. Potentiometers are used 
morredaquce analog voltages’ to one half of their original 
values to reduce undesirable transient effects that occur 
when switching from one segment to the next. А001 апа 4007 
munctlon as toggle switches tosselect the proper segment, 
depending on the logic signal from D13. These two-position 
switches were created by using summer-integrators. One input 
as patched to the initial condition terminal of the integra- 
mor and the other to a normal input; the feedback capacitor 
mame reGed. Whem the іпсергарог 15 іп the reset mode, the 
initial condition input is selected; when the integrator is 
ПИ coupure mode, the other input is selected. 

The normalized slope value of the segment being gener- 
ated is multiplied by the AM function time scale element in 
По уп ајелстај to analog converter MDAI and the product 
SS at T401. The воре а сте пеп геа to integrator 
AOSS which generates the setment. The segment value, break- 
point, and slope sign are directed to comparators CO4 and 
E which together with the other AM function generator 
ШӘРІС-сопропепсов detect when the segment value reaches the 
breakpoint. When this occurs, the logic Signali írom Di, 
changes state and switches A001 and A007 from the (N)th to 
the (N+1)th segment. While the new segment is being gener- 
ей, the values of the next segment are transmitted to 


mre unused poles of the switches by the digital program. 


12 





The time scale of the AM function may also be adjusted 
by P401. Decreasing the setting of P401 has the effect of 
decreasing the period and the amplitude of the function. 

ежремевацеа function appearing ait the output of A055 
EN hen multiplled by the*ampliítude ‘element in MDA2 and che 
product appears at T402. From there it is directed to 
multiplier MOO4, where it is multiplied by the periodic wave 
function from A025. The output of MOO4 is the final 


modulated signal. 


J. AM FUNCTION GENERATOR BREAKPOINT DETECTOR 

ДО to Figure IVF rOn S This circuit IMs@used? to detect 
when the value of a segment being generated reaches the 
breakpoint of that segment. Since the functions being gen- 
EN cd are not monotonic, this can occur under one of four 
meoolble conditions - with the slope positive or negative 
and the breakpoint positive or negative. The states of the 
outputs of the comparators CO4 and C05, ПЕТТА and after 
maee breakpoint is reached, for each of the {our сы ае 
conditions is shown in the table accompanying Figure ІУ-10. 
The nut: required from the circuit was a change of state 
meom а logical one to a logical zero when the breakpoint 
E Геаспес. Етоп спе сасе тар1е, 15 сап Ге свееп спа “һе 


шшроргіасСе“есцаСіоп for the output are 
М121! « 01105! 4 04 05 апа №21 = СН 05! «4 С41С5 


ИЙЛОП can be equivalently expressed as 
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mee first term on the right hand side of Che equation is 
вне output of N221 and the second term is the output of 
№220. The inputs to N421 from N103 and FFO7 are used to 
Мозарђје the breakpoint detector Tncluding themiMbne 


equation for the output of N421 is 


№121 


| 


(№220 N221 N103 FFO7)! 


| 


N22 0E N2211 АНА О ee PROTA 


ЖИЕС Еі госці eonfiguration is also utilized in the ЕМ 


етой generator and the periodic wave function generator. 


K. AM FUNCTION GENERATOR LOGIC 

Refer to Figure IV-11: The output of the’ breakpoint 
detector appears as an input to DF05. 0205, DFO4, and DF03 
Banetion in the same manner as the pulse generator circuit 
of the periodic wave function generator (Figure IV-3). 
Belay-flop DFO5 generates a i25 microsecond pulse that із 
fed through N205, N405, D16, and N105 to reset FFO7. The 
output of FFO7 is fed back to N421 to disable the breakpoint 
detector; it is also fed through buffering gate N206 to T130 
Шеге the digital computer program tests the state of the 
flip-flop to determine if the breakpoint has been reached. 
The output of D16 appears as an input to FF03, causing it 
to change state. This causes A001 and A007 to switch to 


the new segment values (see Figure IV-9). After the digital 
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 тприсег ргоргат has determined that the breakpoint has 

EE ccch-dgutotesvs Terminal#l2/ to determine when the 
ИП сгозесопа pulse fromwDP05 is complete. When it is, 

the digital program sends a pulse to T016 to set FFO7, which 
rearms the breakpoint detector when the output CENTOS has 
meturned to the one state. When changing from one function 
 егпогПһег, (Пе digital@prorram transmits a zero logic signal 
ШОО Т, which causes the breakpoint 2 сое нова Fed 
ру resetting FFO/7 and which also places integrator A055 in 
the reset mode. When the analog computer is put in the 
Metër reset mode ша сто Теріс signal from RI! aceomplishes 


the same thing. 


L. FM FUNCTION GENERATOR 

Refer to Figure IV-12. Segment slope values appear at 
E53 and breakpoint values appear at па шво are atten 
uated 50% by potentiometers.  Track-hold networks A050 and 
A064 hold the values of the (N)th segment while the values 
of the (N+1)th segment wait at T433 ana T404. The slope 
value of the segment being generated is multiplied by the 
ЕМ EE on timewscale ane multiplying digital to analog 
converter MDAO and the product appears at T400. The slope 
is then fed to integrator A053 which generates the segment. 
The segment value, breakpoint, and the slope sign are di- 
mected to comparators COl and C02, which together with the 
meow of the FM function generator logic are used to detect 


when the breakpoint is reached. When this occurs, the 
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track-holds track me new segment for approximately 500 
microseconds and then hold the new values. After the track- 
Eus return to the hold mode, values for the next segment 
are transmitted to Tl33 anda T404. After the eighth segment 
has been generated, the process is repeated. The generated 
funetion 15 directed to summer A052 where їс 3S combineu 

with the signal frequency element, which has been transmitted 
to T405. This combined frequency function is directed through 
amplifier А011 бо the periodic wave function generator. 

өг нег5: А014; “апа A052 serve several functions. First, 
A052 limits the combined frequency function voltage to the 
Eur range of the amplifier. second, by setting the upper 
mae of A052 to a value slightly less than 100 volts, the 
combined frequency signal appearing at the output of AQ1l is 
. always kept greater than zero (a Dem ime imposed by the 


Periodic wave function generator circuit). 


M. FM FUNCTION GENERATOR LOGIC 

Refer to Figure шэг Те operation of the breakpoint 
detector (CO1, C02, N214, N215, and N414) is described in 
the section covering the AM function generator breakpoint 
Betector. When a breakpoint is reached, the change of state 
from one to zero at the input of DFOO causes the delay-flop 
ши гепетабе а 500 microsecond pulses phe output of the 
delay-flop (D') is fed through N400 and N100, where it appears 
as a reset pulse for flip-flop FFOO. The output of FFOO 


is fed back to N414 to disable the breakpoint detector when 
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the flip-flop is E This action is' necessary to prevent 
false triggering of the delay flop when switching from one 
segment to the next. The output of FFOO is also fed through 
a buffering gate, N201, to T104, where its state is tested 

bye the digital computer program to determine’ if “the ргеак- 
point has DEChmreachcd mice OUuUpUgsoe: NI00 ES also fea 
through driver D25 to the track-hold networks, A050 and A064, 
causing them to track the new segment values for 500 micro- 
EE (s and then поза themmew values. The status of the 
track-holds is tested by the digital program at T103 to de- 
termine when the new segment values эмн Бееш тгаСКеС ос 

are being held. When the program determines, that the new 
mMpement values are being held, thei next segment values are 
transmitted to THO4 and T433 (see Figure IV-12) and the pro- 
gram transmits a pulse to T105 es OR: FFOO and arm the break- 
point detector. Zero logic inputs to N417 are used to disarm 
ene breakpoint detector and places integrator А053 in the 
reset mode. This action is required when changing from one 
function to another, at which time the program transmits a 
zero to T020. Placing the analog computer in the master 
reset mode or using the digital switch DS1 accomplished the 


Same thing. 


М. SIGNAL ТІМЕН 

Refer to Figure IV-14. Flip-flops FF10-13 and FF20-27 
are patched to form a binary down counter (the duration 
counter) and are used to time the signal being synthesized. 


The ілібјіал = Сасе ст Бе Гаре и ео орз are used are 
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Bopreschusune Dinary length of the signal duration; woth 

клен теоцеееп ћ corresponding to the аў БЛГ Тлеу Кагеватт = 
tialized by pulses from TOO] - TOl4. The fifteenth bit is 
initially reset by a pulse from T000. Clock pulses to N410 
MIS пе Ое О ООП то апа when Chesrirst. rourteem 
bits peach zaro., ввел  слапгесз расе. вне Г isEred Dack To 
№410 бо disable the counter. “his condition is sensed at 
Т131 by the program to determine that the signal has run 

Fr ts prescribed duration. 

The four-bit preset down counter (at the top of Figure 
IV-14), fed by a 10kHz clock, is used to generate the clock 
pulse that drives the duration counter through N410. By 
Changing the preset condition with the thumb switch, fre- 


НО 1115 х тг сс 0окК pulse can be accomplished, 


thereby time scaling the duration counter. 


№ COMPONENT SETTENGS 

The inputs to all amplifiers use a gain setting of one 
Except the following, which use a gain of ten: A025, А057; 
and AO61.. 

Feedback e pac rs јесте Used. ane as) ст усан 
A025 - 0.001 uF, A031 - 0.010 uF, AO37 - 0.010 uF, 
AO45 - 0.010 uF, A053 - 0.010 uF, A055 - 0.001 uF, 
4057 - 0.001 ҰР, A061 - 0.001 uF. 


Potentiometer and delay flop зе пе5 аге азе го 105. 
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S STEM TESTING 


В. SPECIFIC EXPERIMENTS 

Two simple experiments were attempted in order to test 
the operation of the system. 

1. Music Synthesis 

In the first experiment, some simple sequences were 
synthesized to create musical melodies. The purpose of 
this experiment was to test the technical operation of the 
system rather than to evaluate its practical utility. The 
A.M. function was used to simulate the attack and decay 
characteristics of a musical instrument and the periodic 
wave function was used to set the harmonic content of the 
steady state signals. The frequency elements contained the 
pitch information and were defined to form an equally tem- 
pered scale. Samples of typical functions used are shown 
in Figures V-1 and V-2. Photographs of typical waveforms 
at various places in the analog computer circuitry are shown 
in Figure V-3. The output of the analog computer was 
ЖО „сеа to an amplifier and a loudspeaker. 

The system functioned properly and the programming 
of simple melodies proved to be fairly easy. While specific 
objectives other than to verify the technical operation of 
the system were not rigorously pusued, experimenting with 
the system in the area of music synthesis did tend to show 


some advantages and disadvantages of the system. On the 
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WAVEFORMS FROM ANALOG CIRCUITS 


FIGURE V-3 
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ов сите side, the utility of the interactive and real-time 
Порево: спе &зузсем became evident. Being ableste 
Ецапсе опе отс more of the parameters describing a sound 
(such as the periodic wave or A.M. functions) and then 
being able to immediately synthesize the modified sound 
Ши very userul in relating the significance of the change 
Па“  гстетпесиши thesperceived sound. However, if the 
тел Were Co besused exclusively forymusic synthesis, а 
specialized input device (such as the keyboard used in 
Ashton's interactive organ computer communication network 
[2]) would be more appropriate. 

On the negative side, working with fixed periodic 
functions was a disadvantage in attempting to synthesize 
known musical instrument sounds. In many natural musical 
EHUsLPument sounds, an important factor in providing the 
naturalness Sha distinctive quality of these sounds is the 
ENcment of inarmonicity. This inharmonicity is reflected 
in changing time domain waveforms from pitch period to pitch 
period. In addition, the scarcity of data adequately de- 
scribing the individual harmonics (as a function of time) 
further ОЕ the problem. 

2. Single Equivalent Formants 

In the second experiment, an attempt was made to 
synthesize voiced vowel~like sounds using single formant 
structures believed to be approximately perceptually equiva- 
lent to the multiformant structures of naturally generated 


vowel sounds. The synthesis was attempted using the limited 
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E oprmatlon on single equivalent formants contained in 
НЭГ Зак паеш 2/. Іп Кет. 15, Focht®haseshown that a 
emele equivalent formant combined with'voicingland ampli- 
tude information can be used to represent all speech sounds. 
Reference 27 shows the relationship between the single 
eeuevaleént formants and the multiple formants for various 
phonemes and was used as the basis for the experiment. 

The waveform shown in Figure V-4 (whose frequency 
spectrum is shown in Figure V-5) was amplitude modulated 
my che sinusoid approximation shown in Figure IL-1. The 
objective was to translate the spectrum of the first wave- 
негее the frequency domain as exemplified by Figures 
V-6 and V-7. The frequency of the modulating waveform was 
Шар апбоцис 150 hz to correspond to a typical human voice 
ПИ The resulting sounds were recorded and later observed. 

The evaluation of the sounds was mostly subjective. 
ШЕР resulting sounds were not judged to be good approxima- 
tions of natural voiced vowel sounds, but were at least 
thought to be recognizable approximations. For example the 
"U" phoneme sounded more like that phoneme than others. It 
should be pointed out that the sounds were observed as iso- 
Гей phonemes rather than being placed in the context of 
words. Since the perception of vowel sounds is partially 
mependent on cues provided by adjoining phonemes, it is 
entirely possible that a word context may have provided a 


more favorable evaluation. 
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В. GENERAL OBSERVATIONS ON TESTING 

In Section I-C, three types of function generators used 
пе 5узсет were described. To review, in the first type, 
two D/A channels were used. The slope and breakpoint of one 
segment were transmitted over these channels and then stored 
бу analog devices. Once stored, the same channels were 
used to transmit the data for the next segment. In the 
second type, four channels were used. Two channels were 
used for one segment and two channels were used for the next 
segment. Analog switching devices were used to switch from 
One segment to the next. In LASER ADE сет е о 
were used. All segment slopes were transmitted and then 
stored by analog devices. The same channels were then used 
tO transmit segment breakpoints. 

The two specific experiments previously described demon- 
strated some of the characteristics of these three types of 
сот generator circuits. The first type proved to be 
useful for functions whose frequencies were below about 
E Hz. The primary reason for this was the time required 
for the storage devices to track new values. Also, in this 
type, the SCENES breakpoint was detected by comparing the 
Expi3tude of the segment being generated to the breakpoint 
amplitude. Because of this, errors introduced by the digi- 
tal quantization of analog values and the nonlinearities 
ОГ the analog ае resulted in error in the detection 


 отсакроіпгв,. During one periodiof the function AS 
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errors for а Нал segments е8 cumulative, result m 
imascumulativesirunction frequency Error. In general, the 
Amount olferror was proportional to the*frequency of the 
function. 

ач ед -ссопа суре of function generator, wheresiour 
channels were used, function frequencies up to about 200 Hz 
were possible because The circuit did not have to track 
segment values but only had to switch from one set of values 
to another. Breakpoint detection was ай Зо iy an amplitude 
шопрагізоп method, which resulted in frequency distortion. 

I um cxuIdetypeEomofünetion generator, function fne- 
.quencies up to about 1900 Hz were possible. This type of 
Function generator used a comparison between segment time 
and breakpoint time to detect breakpoints. As a result, 
ШИЕ dastortion of function 227 was minimized but at 
the expense of distortion of segment amplitudes. The pri- 
mary “АЛЕ 22 сһе third type of function generator 
was the time required to switch from one function to another. 
While the time was less than a millisecond, it was still 
very significant from a perceptual standpoint, since the 
"dead time" in between functions is noticable aurally. 

All three types of function generators require that 
“һе integrators that generate the segments be reset between 
functions. In the first two types, however, this would not 
be a problem if the switching between functions were per- 
formed where a segment value coincided with the initial 


ME tion of the next function: Іп the third type, nowever, 


96 





a delay is still N Since all fumetion slopes must 
be transmitted before the breakpoints. If enough D/A 
channels were available to transmit function slopes and 
breakpoints over different channels, this problem could 
Be avoided. 

At this point, some distinctions should be made in the 
causes of the limitations of the three types of function 
Penenaters used. In the operation of the system, all three 
Нор оп generators operate simultaneously and спе control 
of the generators is dependent on the digital as well as 
Kir log computer programming. Thus, limitations result 
аголајју Ггот the efficiency of the digital program. 
other limitations are the result of the electrical capa- 
ша Сіе5 оГ the analog components, such as tracking апа 
recovery times. The development of specialized hardware 
meemore efficient digital coding could improve overall 


efficiency without compromising the perceived quality. 
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УТ. CONCLUSIONS AND RECOMMENDATIONS 


The system displayed considerable utility as an elec- 
Broacoustical tool for the investigation of psychoacousti- 
= l phenomena and as an instructivestool. It also showed 
itself to be useful in the investigation of time domain 
Synthesis using first order segment functions. Its 'inter- 
active capability, graphical I/O, and real-time audio 
K ut were some of its more significant attributes. 

The: interactive nature of thessystem control functions, 
used to direct the hybrid computer system to generate real- 
EmecaudTto output, was demonstrated to be effective in 
Smpcriments which generated musical and voice-like signal 
sequences. 

The system was, however, not without important limita- 
tions. The functions synthesized by the system were limited 
to eight segments each. The system's utility would be 
EXensfjcantly improved if functions with a variable number 
of segments were permitted. The overall capability of the 
system was also restrained by the limited number of analog 
computer components and D/A converter channels available. 

An inherent disadvantage of the system's er 
Beehnique involves the control of the output. Conventional 
digital synthesis (using equally spaced first order segments) 
is essentially stable. Synthesis using higher order and/or 


unequally spaced segments imposes the requirement that the 
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output be а В ПЕС system in order to detect 
segment breakpoints. 

Because of the difficulties arising from the detection 
EbreakpoinUs and the utilization of a limited number of 
momecralspurpose analog computer components, it is concluded 
that practical application of the technique would be signi- 
ficantly improved with the development of specialized 
hardware. 

Utilization of a first order segment time domain syn- 
thesis technique is also dependent on being able to derive 
relatively simple approximations of more complex waveforms. 
.Perceptually equivalent audio signals can be represented by 
number of different time domain waveforms. For example, 
it has been shown that the phase relationship of the fre- 
wency components of speech d M nov important, but 
one particular relationship may result in the most simple 
time domain were Roma Developing mathematical techniques 
Semminimize certain time domain parameters, such as the 
second and higher order derivatives, would be useful in 
developing simple time domain models. However, the final 
evaluation would still have to be made from a perceptual 
rather than a mathematical viewpoint. Another analytical 
problem in deriving the time domain functions involves 
separating the envelope, or amplitude modulation june ааа 
from the composite signal. Since the spectrum of the enve- 


lope usually involves frequencies much less than those of 
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the "carrier," a mathematical technique such as cepstral 
analysis could be applied. 

A final area believed worthy of investigation is that 
 сопвятатір the біте domainysynthesis teehnique with a 
frequency domain technique. The parameters that are better 
described in each domain could then be controlled by the 
Corresponding technique. For example, in conventional 
speech synthesis, formant and pitch trajectories (as 
functions of time) could easily be controlled by first 


order segment functions. 
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APPENDIX A 


S YOTEMISTART Us 


Рот to putting the system into operation, the follow- 


ing steps must pef taken.: 


Potentiometers and delay flops 


Mould be set as indicated in Section IV-0. The analog 


Bomputer should then be placed in the following state: 


POTSET, TIME SCALE, DIGITAL CONTROL. 


If the system is loaded from a FORTRAN source tape, it 


should be mounted on tape unit two (MT2A); if it is loaded 


from a core image tape, it should be mounted on tape unit 


three (MT3A). 


The tape containing user definitions to be 


mercially loaded into the system should be mounted on tape 


ШИІС one (MT1A). 


Sense switch number two should be on. 


Using the core image tape, the following control cards 


шшы required. 


ФРАТСН 
$>>DATA 


077000 
077001 
077002 
077003 
077004 
077005 
$END 
АЈОВ 
ДАСТ 


31677774 
04037730 
10477776 


11511111) 


01037711 
00135677 


AASSIGN Х1=МТЗА 


ARERUN 


When the system's programs are compiled using a FORTRAN 


source tape, the normal XDS 9300 system control cards should 


be preceded by the following. 
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$PATCH 

$>>DATA 

004407 01000000 
004430 00104273 
$9GETBUFF 
000200R 00177000 
077000 31677774 
077001 04037730 
0 7002% 10177776 
077003 17577774 
077004 014037711 
077005 00100203 
$END 

ДАСТ 


$ 9GETBUFF 


AASSIGN 
AASSIGN 
AASSIGN 
AASSIGN 
AASSIGN 
AASSIGN 
AASSIGN 
AASSIGN 
AASSIGN 


SI=MT2A 
10=DF1A 
11=DPr1A 
12=DF1A 
13=DF1A 
14=DF1A 
15=DF1A 
18=DF1A 
51=рЕ1 А 


AASSIGN 52=DF1A 


AASSIGN 75=DF1A 

en the program begins execution, it will type the 
following message on the XDS 9300 teletypewriter: 

ЕН STORAGE TAPE NEW, TYPE NEW; IF OLD, TYPE OLD. 
An "old" tape means one that has user definitions to be 
initially loaded into the system. After the user responds, 
the system will remind the user (using the XDS teletype- 
writer) to make sure the analog computer has been properly 
Prepared and will also ask the user to specify which of the 
AGT's is to be used. The program GATED should have been 


previously loaded and executed in the AGT to be used. 


Following this, system operation is controlled at the AGT. 
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